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Abstract  -  Knowledge  Management  for  Distributed- 
Tracking  (KMDT)  is  a  U.S.  Naval  research  and  devel¬ 
opment  project  to  improve  military-communications  and 
information  functions  in  the  battle  space.  These  func¬ 
tions  include  command,  control,  data  fusion,  and  deci¬ 
sion  support.  It  features  a  scenario  for  modeling  and 
simulation  that  shows  how  knowledge-management 
technologies,  such  as  ontologies  and  intelligent  agents 
can  improve  battle-space  awareness  and  the  decision- 
making  process  in  command  centers  with  respect  to  dis¬ 
tributed  tracking  and  threat  identification  of  targets. 
Data  on  cross  lines  of  bearings  can  be  acquired  from 
sensors  using  a  secure  network.  These  data  and  their 
associated  pedigree  metadata  from  multiple  platforms  in 
the  battle  space  can  be  fused  to  reduce  the  uncertainty  in 
platform  detection,  localization,  classification  and  identi¬ 
fication  (level-one  data-fusion  object  refinement).  The 
pedigree  metadata  can  affect  how  data  are  used  in  fusion 
tasks. 

Keywords-  Decision  support,  distributed  sensing,  level- 
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1  Introduction 

The  Knowledge  Management  for  Distributed  Tracking 
(KMDT)  [4]  [5]  program  assembles  technologies  to  assess 
the  information  content  exchanged  via  secure  network  in 
the  battle  space.  These  technology  areas  include  line-of- 
bearing  (LOBs)  cross  fixing,  sensor  and  pedigree  ontolo¬ 
gies  [2],  [7]  and  intelligent  agents  [1],  The  advantages  of 
using  agents  to  assist  with  data  fusion  are  as  follow.  1) 
They  are  designed  to  reduce  the  workload  of  the  sensor- 
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data  analysts  by  finding,  screening  and  retrieving  data  that 
have  been  chosen  according  to  operator-specific  criteria. 
2)  They  take  advantage  of  the  network-centric  architecture 
in  the  FORCEnet  constmct. 

An  integrated  ontology  can  provide  to  the  agents  a  set  of 
consistent  concepts  that  describe  homogeneous  and  het¬ 
erogeneous  data  fusion  in  general.  A  database  that  has 
been  designed  according  to  a  detailed  ontology  also  can 
serve  as  a  guide  to  selecting  the  best  alternatives  in  a 
given  situation,  according  to  sensor  characteristics,  capa¬ 
bilities,  performance,  environment,  and  location.  Conven¬ 
tional  data-fusion  technologies,  on  the  other  hand  were  not 
designed  to  take  advantage  of  software  agents  and  ontolo¬ 
gies. 

A  goal  of  KMDT  is  to  enable  military  analysts,  sen¬ 
sor-system  operators,  and  commanders  to  reduce  uncer¬ 
tainty  in  command  and  control  by  better  organizing  and 
using  the  data  collected  from  existing  sensors.  Providing 
pedigree  metadata  can  reduce  uncertainty  about  the  valid¬ 
ity  and  reliability  of  the  results  of  a  sensor-data  fusion 
task.  Specifically,  the  KMDT  program  is  testing  the  hy¬ 
pothesis  that  cross  LOBs,  whether  heterogeneous  or  ho¬ 
mogeneous  can  be  obtained  for  the  identification  and  clas¬ 
sification  of  unknown  targets.  In  the  present  state  of  the 
KMDT  simulation,  the  following  pedigree  metadata  are 
collected  for  each  detected  LOB:  Location  of  sensor,  in 
terms  of  latitude  and  longitude,  date  time  group  of  detec¬ 
tion,  sensor  identification  number,  and  frequency  detected. 
These  metadata  support  and  accompany  each  LOB  meas¬ 
urement. 

Using  technology  developed  in  the  KMDT  [4]  [5]  and 
other  [10]  programs,  strategies  for  data  fusion  are  facili¬ 
tated  that  previously  were  inefficient  or  impossible  given 
the  timeframe  for  analysis  in  time-critical  scenarios  [3], 
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New  approaches  to  tracking,  fusion  and  command  and 
control  are  now  possible  in  this  network-centric  environ¬ 
ment.  During  their  task  execution,  intelligent  agents  can 
access  web  portals  on  the  network  to  obtain  information 
relevant  to  current  requirements  for  sensor-data  and  pedi¬ 
gree  metadata  provided  that  they  are  aligned  to  a  common 
frame  of  reference  in  time  and  space.  This  common  refer¬ 
ence  frame,  sometimes  call  the  common-operating  picture 
or  the  Single  Integrated  Picture  (SIP)  is  essential  to  the 
success  of  many  data-related  activities,  including  LOB 
cross  fixing  and  any  other  data-fusion  strategy  that  relies 
on  the  SIP. 

Multi-sensor  data  fusion  [9]  can  be  used  to  refine 
knowledge  of  the  battle  space  in  ways  that  are  not  possible 
with  data  from  a  single  sensor.  Not  only  can  multiple  ho¬ 
mogeneous  sensors  track  individual  platforms,  but  also 
multiple  sensor  types  can  participate  in  a  level-one  data 
fusion  task  [1],  [9]  (e.g.  detection,  localization,  classifica¬ 
tion,  and  identification)  coordinated  by  intelligent  agents, 
thus  reducing  uncertainty  in  command  and  intelligence 
centers.  Agent-assisted  data  fusion  can  provide  the  proc¬ 
essed  data  needed  for  enhanced,  distributed  heterogeneous 
level-one  data  fusion. 

The  following  terminology  will  be  used  throughout 
the  paper.  “Platform”  means  an  entity,  usually  mobile,  that 
has  a  sensor  system,  such  as  a  friendly  ship  or  aircraft. 
“Contact”  refers  to  a  detected  signal  originating  from  a 
source  that  has  yet  to  be  localized,  tracked,  classified  or 
identified.  “Target”  refers  to  the  object  of  a  level-one  fu¬ 
sion  task,  particularly  if  at  least  one  signal  from  the  object 
has  been  identified  or  localized. 

This  paper  is  organized  as  follows.  Section  2  con¬ 
trasts  data  collection  with  data  utilization.  Section  3 
briefly  discusses  LOB  cross  fixing.  Section  4  describes 
pedigree  metadata  to  support  level-one  fusion.  Section  5 
describes  strategies  for  level-one  sensor  data  fusion.  Sec¬ 
tion  6  presents  a  discussion  of  future  directions  to  con¬ 
clude  the  paper. 

2  Data  collection  vs.  data  utilization 

Commanders  and  sensor  operators  often  are  overloaded 
with  tasks  and  uncorrelated  information.  Conversely,  they 
sometimes  have  difficulty  in  obtaining  the  correct  infor¬ 
mation  they  need  to  make  timely  decisions,  so  decisions 
are  made  using  uncertain  information.  Locally  collected 
data  often  are  lost  or  wasted  if  they  cannot  be  correlated  in 
a  timely  manner  with  data  from  remote  sensors  and  obser¬ 
vations.  Similarly,  data  from  remote  sensors  that  are  not 
controlled  locally  would  not  be  transmitted  efficiently 
(and  sometimes  not  at  all)  if  no  payoff  were  perceived  for 
their  propagation.  To  respond  rapidly,  the  commander 
may  need  the  data  that  neither  are  available  locally  nor 
transmitted  from  remote  sensors. 

The  majority  of  sensor  data  are  not  used  because  the 
methods  and  speed  of  data  communications,  data  fusion, 
and  data  analysis  have  not  kept  pace  with  the  deployment 
of  sensor  arrays  and  the  multitude  of  sensors  that  collect 
data  continuously.  Some  information,  such  as  knowledge 
implicit  in  imagery,  is  difficult  to  analyze  as  fast  as  the 


data  can  be  collected.  The  timeframe  for  using  these  data 
is  limited.  Data  and  their  associated  pedigree  metadata 
must  be  made  available  when  they  are  needed  for  making 
decisions. 

The  increased  knowledge  (as  opposed  to  an  increase 
in  only  unprocessed  data)  available  in  the  battle  space  as  a 
result  of  the  network  and  SIP  also  can  help  reduce  the 
tasking  of  overloaded  operators  who  could  otherwise  fo¬ 
cus  on  tasks  that  are  not  being  done  due  to  lower  priori¬ 
ties.  Information  usually  is  shared  among  individuals  and 
groups  in  communities  of  interest  (COI).  Members  of  the 
COI  need  to  be  able  to  see,  access,  and  understand  the 
data  to  accelerate  decision  making.  2)  The  take  advantage 
of  network  technology  that  was  not  available  in  the  days 
of  platform-centric  warfare,  and  3)  Being  in  a  position  to 
complete  temporarily  low-priority  tasks  may  provide  an 
advantage  in  the  battle  space  because  task  priorities  can 
change  and  the  outcome  of  one  task  affects  the  execution 
of  another.  Some  tasks  cannot  be  completed  in  a  timely 
manner  without  distributed-network  technology,  for  ex¬ 
ample,  LOB  cross  fixing  in  which  sensors  on  board  differ¬ 
ent  mobile  platforms  are  used. 

3  Registration  through  LOB  cross  fix¬ 
ing 

Sensors  deployed  on  a  single  platform,  such  as  a  ship,  can 
provide  LOB  information  on  unknown  contacts  and  poten¬ 
tial  targets  in  their  vicinity.  Cross  LOB  targeting  (i.e.  us¬ 
ing  sensor  data  from  two  ships)  either  is  not  done  or  it  is 
limited  to  homogeneous  sensor  systems  (e.g.  all  acoustic 
sensors).  Thus,  information  about  multiple  LOBs  that 
could  localize  the  position  of  a  target  often  does  not  reach 
a  command  center  in  time  to  support  the  decision  process. 
Sometimes  operators  do  not  know  what  to  do  with  new 
data  that  are  not  correlated  with  existing  data.  Such  data 
fail  to  reach  the  threshold  of  information  to  support  deci¬ 
sion  confidence. 

4  Pedigree  metadata  for  data  fusion 

Even  when  sensor  data  are  available,  the  reliability  of  the 
data  may  be  called  into  question  in  the  absence  of  pedi¬ 
gree  metadata,  the  use  of  which  is  becoming  as  important 
as  the  data  themselves.  A  datum,  whether  it  is  a  frequency, 
a  pulse  repetition  rate,  or  a  line  of  bearing  derives  its  va¬ 
lidity  from  the  manner  in  which  it  was  obtained,  the  way  it 
was  processed,  the  reliability  of  the  data  with  which  it  was 
fused,  and  other  information  regarding  its  source. 

Collecting  sensor  data  and  making  them  available  on 
a  network  is  necessary  but  insufficient  for  operational  use. 
Users  are  demanding  a  higher  level  of  reliability  and 
trustworthiness  of  data  and  the  decisions  based  on  them. 
The  demand  is  growing  for  precise  target  location,  selec¬ 
tion,  and  improved  data  fusion  to  match  the  precision  of 
today’s  weapon  systems.  Precision  ordnance  on  the  wrong 
target  wastes  resources.  Sufficient  metadata  must  be  made 
available  to  support  the  growing  demands  of  users. 

Although  the  reliability  of  data  reflects  a  second  order 
uncertainty  [6]  and  is  somewhat  subjective,  many  factors 


contribute  to  whether  or  not  data  should  be  trusted  and  in 
what  context  [11].  These  factors  will  vary  across  many 
dimensions,  such  as  the  level  of  data  fusion  and  the  expec¬ 
tation  of  the  users  who  are  in  direct  support  of  the  decision 
makers.  At  level-one  data  fusion,  data  aggregates  and  their 
pedigree  are  simple  in  comparison  to  the  level  of  data  ag¬ 
gregation  and  processing  for  levels  two  and  three  (situa¬ 
tion  assessment  and  threat  assessment  respectively).  Pedi¬ 
gree  collection  and  propagation  at  level  one  data  fusion 
can  support  the  pedigree  management  at  higher  levels. 

Two  categories  of  pedigree  data  relate  to  level-one 
sensor  data  fusion  depending  on  when  they  are  applied  - 
before  fusion  begins  and  after  the  data  have  been  proc¬ 
essed  with  fusion  engines.  Before  fusion,  the  pedigree 
metadata  can  assist  in  making  the  best  data  selection  to  be 
processed  with  fusion  engines.  After  fusion,  the  informa¬ 
tion  that  describes  the  fusion  process  becomes  part  of  the 
growing  body  of  metadata  that  accompanies  the  finished 
products  and  allows  reassessment. 

Many  factors  affect  the  validity  and  reliability  of 
fused  sensor  data  both  before  and  after  fusion.  Of  these 
many  factors  and  aspects  of  metadata  pedigree  that  con¬ 
tribute  to  the  determination  of  the  extent  to  which  data  can 
be  trusted  [11]  and  subsequently  fused  (or  not  included  in 
the  fusion  process),  the  following  factors  emerge  as  the 
most  important  or  useful  to  level-one  fusion: 

1.  Date-time  group  (DTG)  when  the  signal  was  col¬ 
lected.  For  obvious  reasons  it  is  most  desirable  to 
fuse  data  collected  at  the  same  time.  Otherwise 
the  users  could  see  different  pictures  of  the  battle 
space  and  possibly  draw  wrong  conclusions  [5], 

[H]. 

2.  Latitude  and  longitude  of  the  collection  platform 
at  the  time  of  collection.  Like  DTG,  the  exact  lo¬ 
cation  of  the  collection  platform  can  be  critical  to 
the  “fusability”  of  data. 

3.  Maximum  range  of  sensor  [5]  compared  to  the 
distance  between  sensor  and  source  -  Signals  de¬ 
grade  as  they  propagate,  especially  through  a 
noisy  medium.  Sensors  may  not  perform  well  at 
the  extremes  of  their  ranges. 

4.  Coverage  of  sensor  [5]  compared  to  the  angle 
from  which  the  signal  originates.  Coverage  may 
not  be  equally  reliable  at  the  various  angles  even 
when  detections  can  be  made. 

5.  Location  of  possible  noise  sources,  if  known. 

6.  Peak  frequency  and  range  of  noise  compared  to 
the  peak  frequency  of  the  signal.  If  noise  at 
10kHz  it  might  not  affect  a  signal  with  a  peak 
frequency  at  500Hz. 

7.  Sensor  type  and  mode  [5].  Have  these  types  of 
sensors  provided  reliable  data  in  the  past  when 
used  in  this  mode? 

8.  Sensor  resolution  capability  [5].  This  pertains  to 
spatial  and  frequency  resolution.  Can  the  sensor 
provide  range  as  well  as  bearing?  What  is  the  er¬ 
ror  associated  with  the  range  measurement?  Can 
the  sensor  be  used  to  discriminate  two  signals  at 
whose  frequency  spectra  overlap? 


9.  Environmental  factors  [5],  such  as  weather,  at¬ 
mospheric  conditions,  sea  state,  and  bathyther- 
nrography  that  could  affect  signal  propagation 
through  the  medium. 

10.  Reputation  of  the  sensors  [11]  -  Are  these  sen¬ 
sors  known  to  perform  well  under  the  collection 
conditions? 

11.  Presence  or  absence  of  deceptive  signals  in  the 
frequency  range  of  the  signal’s  peak  frequencies 
[11]. 

12.  Presence  or  absence  of  alternate  sources.  Are 
multiple  LOBs  available?  Which  ones  are  more 
reliable?  Some  sources  may  be  utilized  simply 
because  no  other  option  is  available  [11]. 

Some  of  these  factors  that  contribute  to  pedigree 
metadata  consist  of  static  data,  such  as  sensor  characteris¬ 
tics  and  performance,  whereas  other  data  are  dynamic, 
such  as  platform  positions  and  DTGs.  When  these  factors 
are  taken  into  account  in  the  level-one  fusion  process,  it 
could  affect  the  fusion  strategy  for  processing  recent  data 
and  also  the  collection  strategy  for  future  data. 

After  the  fusion  process,  which  can  involve  various 
techniques  and  engines,  the  pedigree  metadata  described 
above  still  can  indicate  how  much  the  finished  fusion 
product  can  be  trusted.  In  addition  to  these  metadata,  a 
complete  set  of  pedigree  metadata  describing  the  finished 
fusion  product  will  include: 

1.  Names  and  origins  of  fusion  engines  or  algo¬ 
rithms. 

2.  Sensor  data  or  data  sets  that  the  engines  proc¬ 
essed  and  why  they  were  chosen. 

3.  The  order  of  processing,  if  more  than  one  engine 
or  two  data  were  used.  (See,  for  examples  [3]). 

4.  Known  limitations  of  the  selected  methods. 

5.  Whether  or  not  the  fusion  engines  were  used  ac¬ 
cording  to  the  way  in  which  they  were  designed 
to  be  used.  Sometimes  a  fusion  engine  with 
known  limitations  may  be  used  in  the  absence  of 
better  alternatives. 

6.  Confidence  of  conclusion  reached  and  alternate 
possible  hypothesis. 

5  Strategies  for  level -one  sensor  data 
fusion 

Networks  can  enable  and  facilitate  knowledge  discovery 
[8]  at  a  level  that  is  not  possible  in  a  static,  stand-alone 
environment.  Knowing  the  pedigree  of  information  col¬ 
lected  from  one  source  can  influence  the  strategy  for  col¬ 
lecting  other  sensor  data  in  the  same  environment  [10]. 
For  example,  network  communications  can  help  simplify 
heterogeneous  sensor  fusion  to  homogeneous  sensor  fu¬ 
sion.  An  example  of  this  is  explained  below. 

Homogeneous  sensor  fusion  has  a  degree  of  simplic¬ 
ity  that  heterogeneous  sensor  fusion  lacks.  In  homogene¬ 
ous  sensor  fusion,  the  frequency  spectra  of  acoustic  sig¬ 
nals,  for  example,  can  be  compared  directly.  However,  in 
heterogeneous  sensor  fusion,  the  spectra  of  signals  ob¬ 
tained  from  different  sensor  types  (e.g.  acoustic  and  elec¬ 
tromagnetic)  are  not  expected  to  look  alike  and  the  con- 


elusion  that  heterogeneous  sensors  have  detected  the  same 
contact  must  be  reached  through  inference.  For  example 
one  would  need  to  consider  the  classes  of  targets  that 
could  give  rise  to  both  sets  of  signals. 

Using  software  agents-based  technologies,  sensor- 
fusion  strategies  can  be  used  that  previously  were  either 
notional  only  or  too  difficult  or  detailed  to  complete  in 
real  time.  For  example,  consider  the  following  scenario. 
Using  an  acoustic  sensor,  Ship  A  obtains  a  LOB  of  an 
unknown  contact.  Using  agents  deployed  on  the  network, 
an  operator  on  Ship  A  obtains  a  cross  LOB  from  Ship  B, 
which  obtained  the  LOB  using  an  electromagnetic  sensor. 

The  operator  on  Ship  A  would  like  to  know  if  the 
contact  detected  by  Ship  B  is  the  same  as  the  contact  de¬ 
tected  by  Ship  A.  However,  even  with  complete  pedigree 
metadata,  not  enough  information  is  available  for  a  defini¬ 
tive  determination  because  the  sensor  types  are  different. 
Therefore,  the  operator  on  Ship  A  tries  to  detect  the  un¬ 
known  target  using  the  same  sensor  type  as  the  one  that 
generated  the  cross  LOB  on  Ship  B.  (The  updated  position 
can  be  estimated  using  dead  reckoning.)  Now  sensor  data 
can  be  used  more  efficiently  because  the  signals  are  di¬ 
rectly  comparable. 

The  question  arises,  why  did  the  operators  on  ships  A 
and  B  not  use  the  same  sensor  type  to  detect  the  target 
during  the  initial  LOB  and  cross  LOB  signal  detection? 
Various  reasons  could  include  the  following: 

1 .  Until  the  cross  LOB  was  received,  the  operator  on 
Ship  A  would  not  have  known  which  sensor  on 
Ship  B  had  detected  the  unknown  contact. 

2.  The  unknown  contact  may  have  been  out  of  the 
range  of  the  same  sensor  type  at  the  time  of  initial 
detection. 

3.  A  sensor  of  the  same  type  may  not  have  been  op¬ 
erable  at  the  time  of  the  initial  detection. 

Another  strategy  is  for  the  sensor  analyst  on  ship  B  to 
search  for  the  target  using  the  same  sensor  type  as  the  one 
that  made  the  initial  contact  on  Ship  A.  A  comparison  of 
the  spectra  of  the  signals  would  provide  a  confirmation 
that  the  sensors  on  the  two  ships  had  detected  the  same 
target.  Hence,  heterogeneous  sensors  can  lead  to  homoge¬ 
neous  data  fusion.  This  strategy  is  expected  to  work  for 
the  detection,  localization,  tracking,  classification,  and 
identification  of  slow-moving  ships.  It  would  have  limited 
utility  for  the  detection  of  aircraft  because  the  aircraft 
speeds  would  preclude  a  detailed  analysis. 

One  of  the  advantages  of  a  network-centric  architec¬ 
ture  [1]  is  that  a  commander  can  task  a  sensor  or  request 
tasking  from  a  sensor  that  resides  on  different  platforms. 
This  is  another  way  in  which  web-enabled  communica¬ 
tions  can  support  data  fusion.  For  example,  consider  an 
operator  who  has  three  LOBs  that  are  suspected  to  pertain 
to  the  same  contact.  If  these  LOBs  do  not  all  cross  on  one 
point  but  instead  form  a  triangle,  the  operator  will  need  to 
determine  which  LOBs  to  use  or  how  to  fuse  the  informa¬ 
tion  provided  by  all  three  LOBs.  The  operator  can  survey 
the  SIP  online  and  identify  a  ship  that  is  closer  to  the  con¬ 
tact.  The  ship’s  commander  can  request  an  additional 
LOB  from  a  sensor  on  the  remote  ship  to  clarify  the  posi¬ 
tion  of  the  contact. 


6  Directions  for  future  work 

Automated  tools  are  needed  to  manage  pedigree  metadata 
for  data  analysts  who  are  working  on  level-one  fusion 
tasks.  These  software  tools  are  needed  to  support  various 
strategies  described  here  for  level-one  data  fusion.  These 
tools  can  include  displays  that  highlight  the  location  of 
groups  of  sensors  with  the  same  capabilities  and  their  lo¬ 
cations  in  the  battle  space.  Thus,  an  operator  or  com¬ 
mander  can  select  the  sensor  to  task  for  cross  LOB  or  to 
obtain  a  report  from  a  homogeneous  sensor. 

Posting  of  data  and  pedigree  metadata  to  shared 
spaces  for  COI  access  is  needed  except  when  limited  by 
security  or  policy  constraints. 

Public  Key  Infrastructure  (PKI)  certificate  authentica¬ 
tion  can  improve  trust  and  reliability  of  sensor  data  ob¬ 
tained  on  the  network  on  a  node-by-node  basis.  Experi¬ 
ments  and  quality  assurance  testing  should  be  conducted 
to  validate  overall  network  reliability  as  well  as  the  reli¬ 
ability  of  sensors  and  the  data  they  provide  to  net-based 
users.  Lastly,  tagging  of  data  with  pedigree  metadata  can 
enable  knowledge  discovery  by  unanticipated  users. 
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